LIGHTSURF TECHNOLOGIES. INC. 
LS/0001.02 , 
SHEET! OF ^ 



o 









> 


> 


CO 




D- 




co 


CD 


Q 


b 






I/O BUS 



CO 

o 



7X 



CO 

o 



DC 

< O 

in CL 

i 

CO 



o 
o 



7S 



o 



1 



C CO 
fc CC 

^(3 



in 
o 



i 



CO 

00 CO 

CM 



7\ /\ /\ 



DATA BUS 



CD 



ADDRESS BUS 



7\ 



CO 

o 



CD S 
O) (O 

cc a> 
c o 
S o 

v_ 



CO 




0) 


CD ^ 


MBv 
ivii-)y 


Imag 

DRAI 








o 
o 
O 

CNJ 

o 
o ^ 

00 Q 
CM ^ 



o 

CO 

c 

0) 
CO 

CO 

o 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0009.00 
SHEETS OF ^ 



CO 

Qco 

— CL P 
CO CL < 
OQ< Q 



CL 



LU 



LU 
CO 



O LU 

~ a: 
<: <, 
o § 



□l O 
< CO 





QQ 
CD 









< ^ 






CO 


r 


Q 


LO 





LIGHTSURFTECHNOLOGiES, INC. 
LS/0001.02 
SHEET J_ OF 23 



200 



-201a 



■201b 



■201c 



■201d 



APPLICATION 
PROGRAM 1 



APPLICATION 
PROGRAM 2 



IMAGE 
PROCESSING 



BROWSER 
PROGRAM 



[...] 



APPLICATION 
PROGRAM N 



OPERATING SYSTEM 
(e.g., WINDOWS 9X/NT, SOLARIS, UNIX, LINUX, MAC OS) 



GRAPHICAL USER 
INTERFACE 



^215 Y 



220 



210 



DEVICE DRIVERS 
(e.g., WINSOCK) 



230 



BIOS 
(MICROCODE) 



DISPLAY MONITOR 

NETWORK INTERFACE 

COMM PORT 

KEYBOARD 

MODEM 

MOUSE 

DISKS 

PRINTER 



FIG. 2 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 ^ , 
SHEET jL OF 2J 




COLOR 
TRANSFORMATION 



•315 



YUV 

TRANSFORMATION 



■317 



JPEG 
COMPRESSION 



■318 



FLASH MEMORY 
STORAGE 



COMPRESSED 
JPEG FILE 




319 



WIRE-BASED TRANSFER 
TO TARGET PLATFORM 



320 



321 



IMAGE CAPTURE 



323 



COLOR PLANE 
SEPARATION 



■330 



WAVELET TRANSFORM 
(ONE OR MORE TIMES) 



340 



COMPUTE-EFFICIENT 

COMPRESSION 
(e.g., HUFFMAN/RLE) 



Q 
LU 

is 

coo 

o 
a: 

CL 



COMPRESSED 
LUMINOSITY 
RECORD 



WIRELESS TRANSFER 
TO TARGET PLATFORM 




FIG. 3A 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.01 ^ 
SHEET OF 23 



370 



\mi\sm (LL) 


LOW/HIGH (LH) 


HIGH/LOW (HL) 


HIGH/HIGH (HH) 



380 



LL 


LH 




HL 


HH 







390 



LL 


LH 






HL 


HH 











FIG. 3B 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 ^ 
SHEET (t> Of 




FIG. 3C 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02^^ 
SHEET i OF ^5 




FIG. 3E 



LiGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 , 
SHEETS OF ^ 





FIG. 3G 



LiGHTSURF TECHNOLOGIES. INC. 
LS/0001.02 , 
SHEET A_ OF 25 




% FIG. 3H 




FIG. 31 



UGHTSURF TECHNOLOGIES, INC. 
SHEET ro. OF 13 





LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 ^^ 
SHEET IL OF 



RECEIVE COMPRESSED 
LUMINOSITY RECORD 
FROM DIGITAL CAMERA 



Q 
LU 

ii 

Q-l— 
LUUJ 

cQ<t; 

8^ 

Cd 

a. 



■410 



FIRST STAGE 
RESTORATION: 
REVERSE GENERIC 
COMPRESSION 



■420 



SECOND STAGE 
RESTORATION: 
REVERSE WAVELET 
TRANSFORM 



■430 



'UNCOMPRESSED/ 
LUMINOSITY 
RECORD 



■440 



NEW PROCESS 
PER PROCESS 
STEPS 315-319 



COMPRESSED 
JPEG FILE 




450 



FIG. 4B 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 , 
SHEET I^OFU 



o 




ei 



LIGHTSURF TECHNOLOGIES, iNC 
LS/0001 02 , 
SHEET f'S OF 2-5 



3: 

CD 



a 



CO 



LAYER 
02 


LAYER 
12 


LAYER 
22 




LAYER 
11 




^° 




LAYER 
00 


LAYER 
10 


LAYER 
20 



CD 



I— 

ua 
P 



CO 



3: 

CD 



Ainvno 



LiGHTSURF TECHNOLOGIES, INC. 
SHEET Mi OF 15 



CD 

in 



O 

00 
LU 



a: 

^CVJ 



Ainvno 



>:c\j 



CO 
CO 



o 
ei 

u: 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 ^ 
SHEET /£ OF 23 



600 



610 



PICTURE HEADER 

WIDTH 

HEIGHT 

APERTURE 

EXPOSURE TIME 

GAINS (RGB) 

TIMESTAMP 

THUMBNAIL 



RECORD 00 



630 



LAYER DIRECTORY 

LAYER 00: RECORD NAME 
LAYER 01: 



/ 



620 



LAYER 22: 



RECORD HEADER: 



OFFSET, LENGTH 
OFFSET, LENGTH 
OFFSET, LENGTH 



631 



YDATA 
UDATA 



635 



VDATA 



RECORD 22 



FIG. 6A 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 
SHEETlkOFl5 



650 



BEGIN ^ 







THE PICTURE IS CAPTURED FROM THE SENSOR 
(e.g., CMOS SENSOR) 






SEPARATE DATA INTO THREE SEPARATE PLANES, 
BASED ON THE COLOR SPACE EMPLOYED, 
SUCH AS YUV OR RGB COLOR SPACE 




r 


TRANSFORM EACH PLANE INTO SEPARATE BANDS 
(e.g., WAVELET OR DCT TRANSFORMATION) 






QUANTIZE DATA 






CODE DATA (e.g., ENTROPY CODING) 






ORGANIZE DATA INTO QUA 

STARTING WITH LC 
SELECT NEXT LAYf 
REPEAT UNTIL D0[ 


LITY/RESOLUTION LAYERS: 

)WEST LAYER, 
ER FOR MATRIX. 
^E. 



651 



652 



653 



654 



655 



656 



DONE 



F/G. 6B 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 
SHEET /'^ OF 



BEGIN ^ 



1 




WHEN THE IMAGING DEVICE IS FIRST CONNECTED TO THE 
TARGET DEVICE, TRANSMIT THE HEADER INFORMATION 


1 





THE TARGET DEVICE READS THE RECORD DIRECTORY 
SO THAT IT MAY ACCESS THE INDIVIDUAL LAYERS THAT 
COMPRISE THE IMAGE INFORMATION 



BEGINNING WITH LOWEST LAYER, FETCH NEXT LAYER 
AND UPDATE THE CORRESPONDING DIRECTORY ENTRY; 
RE-ESTABLISH CONNECTION AS NEEDED 




r 


SELECTIVELY TERM 
(e.g., IF WIRELESS 


INATE CONNECTION 
COMMUNICATION) 




F/G. 7 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0001.02 , 
SHEET J4 OF 



■800 



PICTURE HEADER 

WIDTH 

HEIGHT 

APERTURE 

EXPOSURE TIME 

GAINS (RGB) 

TIMESTAMP 

THUMBNAIL 



LAYER DIRECTORY 

LAYER 00: OFFSET/LENGTH 
LAYER 01: " 



LAYER 22: 



RECORD 00 



RECORD HEADER; 

Y: OFFSET, LENGTH 
U: OFFSET, LENGTH 
V: OFFSET. LENGTH 



YDATA 
UDATA 
VDATA 



RECORD 22 



FIG. 8 



LIGHTSURF TECHNOLOGIES. INC. 
LS/0009.00 , 
SHEET _tB OF M 




LiGHTSURF TECHNOLOGIES, INC. 
LS/0009.00 , 
SHEETS OF 1^ 




LiGHTSURF TECHNOLOGIES, INC. 
LS/0009.00^, 
SHEETS OF ?3 



BEGIN 



•1101 



A CONNECTION REQUEST IS RECEIVED AT THE MEDIA 
SPOOLER FROM THE CAPTURING DEVICE 



THE REQUEST MUST BE CONFIRMED TO BE A VALID REQUEST 



THE USER ACCOUNT HAS BEEN VALIDATED AND PERTINENT 
INFORMATION CHARACTERIZING THE ACCOUNT HAS BEEN 
RETRIEVED FROM THE SERVER INFRASTRUCTURE FOR 
USE BY THE MEDIA SPOOLER 



THE MEDIA MANAGER MAY PROCEED TO ALLOCATE A 
PARTICULAR THREAD FROM THE THREAD POOL FOR 
SERVICING THAT PARTICULAR CONNECTION REQUEST; 
THE ALLOCATION THREAD WILL OFFLOAD DATA FROM THE 
CAPTURING DEVICE 



THE MEDIA SPOOLER, UNDER THE CONTROL OF THE MEDIA 
MANAGER, INITIATES A "REVERSE" REQUEST (I.e., BACK TO 
THE CAPTURING DEVICE) THAT ASKS THE CAPTURING 
DEVICE TO IDENTIFY WHAT PICTURES (OR OTHER DATA 
OBJECTS OF INTEREST) IT CURRENTLY STORES 



CONTINUE TO FIG. 11B 



FIG. 11 A 



LIGHTSURF TECHNOLOGIES, INC. 
LS/0009.00 ^^ 
SHEET 1?-0F 13 



CONTINUED FROM FIG. 11 A 







■1106 


SERVERS MANAGER CONTACTS THE SERVER 
INFRASTRUCTURE FOR OBTAINING INFORMATION 
REGARDING USER SINCE THE LAST TIME USER LOGGED 
ONTO THE SYSTEM 








-1107 


SERVER INFRASTRUCTURE MAY RETURN A LIST OR LOG 
INDICATING WHAT PARTS - IDENTIFIED BY GUIDS AND BY 
PART NUMBERS - CURRENTLY RESIDE AT THE SERVER 
INFRASTRUCTURE 








-1108 


THE SYNCHRONIZATION MANAGER MAY DETERMINE 
EXACTLY WHAT PARTS RESIDE ON THE CAPTURING DEVICE 
THAT STILL NEED TO BE RETRIEVED 








-1109 


THE MEDIA MANAGER MAY NOW INSTRUCT THE 
PREVIOUSLY-ALLOCATED THREAD TO RETRIEVE THE DATA 
ASSOCIATED WITH THE IDENTIFIED REQUIRED PARTS 








-1110 


THE MEDIA MANAGER MAY PULL THE COMPLETED PARTS 
FROM THE CACHE MODULE AND THEN PASS THEM TO THE 
SERVERS MANAGER FOR DELIVERY TO THE SERVER 
INFRASTRUCTURE 





^ DONE ^ 



FIG. 11 B 



LIGHTSURF TECHNOLOGIES, iNC. 
LS/0009.00 , 
SHEET ^3 OF «i5 



Media Spooler (Gateway) Protocol Session 



Camera Device 
(Visual Communicator) 



Media Spooler/Gateway 



Server Infrastructure 
Web Server 



Initiates TCP Connection 

^ Sends Authentication Challe nge 
Acknowledgement 

Requests Authentication Response 
Sends Authentication Respon se 

^ Requests Camera ID 

Sends Camera ID 

^ Request "Tagged" Pictures 
Sends Picture Info _ 



Request "Chunk" of Picture 



Sends "Chunk" of Picture^ 



Request Picture Subset To Download 
^end Byte-level List of Pictures to Download 



Upload Chunk of Picture 
Acknowledgement 



Closes TCP Connection 



FIG. 11 C 



